If you haven’t already, please refer to the Template Overview page for an overview of Chat Templates.

​
Pulling a template using the SDK

Using the Baserun SDK, you can retrieve a template stored in Baserun’s Prompt Registry. This way, your templates don’t need to be committed in your code, and can be updated almost instantly.

Each template can be deployed to different environments, and the SDK will automatically pull the correct version based on the ENVIRONMENT environment variable.

import baserun
import openai


async def answer_question(question: str):
    # Download the template from Baserun based on the name and environment (`ENVIRONMENT` environment variable)
    template = baserun.get_template("question_and_answer")
    # Format the prompt, then send it to OpenAI
    prompt = await baserun.format_prompt(
        template_name=template.name,
        template_messages=template.active_version.template_messages,
        parameters={"question": question},
    )

    client = AsyncOpenAI()
    completion = await client.chat.completions.create(
        model="gpt-3.5-turbo",
        messages=prompt,
    )
    return completion.choices[0].message.content